Hey @srogmann! Thank you for this contribution :) Yeah, we will definitely work sth out from these PRs :)

@ggerganov could u also please take a look at this and test your edge cases?

@watamario15 @squik67 also some feedback & testing from you would be really useful :)

These are still not rendered (using gpt-oss):

Okay, thanks for reporting @ggerganov. I'd like to wait just a bit longer for @watamario15 and @squik67 to add their feedback and verify if there are more edge cases to be addressed before we introduce any further improvements to this.

Thanks for the tests! I can reproduce the non-rendered formulas. The \[-marker is not at line-begin in the non-working cases.

Example: working and non-working.

- Algebra:
\[
x = \frac{-b \pm \sqrt{\,b^{2}-4ac\,}}{2a}
\]
- Algebra: \[
x = \frac{-b \pm \sqrt{\,b^{2}-4ac\,}}{2a}
\]

I'll have a look at it.

From my quick check, this doesn't get rendered:

- 1 kg の質量は  
  \[
  E = (1\ \text{kg}) \times (3.0 \times 10^8\ \text{m/s})^2 \approx 9.0 \times 10^{16}\ \text{J}
  \]  
  というエネルギーに相当します。これは約 21 百万トンの TNT が爆発したときのエネルギーに匹敵します。

It's working well on my end with these ↑ commits. Thanks!

(I found a small issue where GPT-OSS tends to escape *s in expressions, resulting them being rendered as \*. Not that important, just fyi.)

Oh, it looks like erroring on

\[
\boxed{
\begin{aligned}
N_{\text{att}}^{\text{(MHA)}} &=
h \bigl[\, d_{\text{model}}\;d_{k} + d_{\text{model}}\;d_{v}\, \bigr]   && (\text{Q,K,V の重み})\\
&\quad+ h(d_{k}+d_{k}+d_{v})                                          && (\text{バイアス Q,K,V）}\\[4pt]
&\quad+ (h d_{v})\, d_{\text{model}}                                 && (\text{出力射影 }W^{O})\\
&\quad+ d_{\text{model}}                                            && (\text{バイアス }b^{O})
\end{aligned}}
\]

@watamario15 Thanks! The rendering is now better, but the spacers (e.g. [4pt]) still cause display issues.